Computational and Statistical Boundaries for Submatrix Localization in a Large Noisy

نویسندگان

  • T. Tony Cai
  • Tengyuan Liang
  • Alexander Rakhlin
چکیده

We study in this paper computational and statistical boundaries for submatrix localization. Given one observation of (one or multiple non-overlapping) signal submatrix (of magnitude λ and size km×kn) embedded in a large noise matrix (of size m × n), the goal is to optimal identify the support of the signal submatrix computationally and statistically. Two transition thresholds for the signal to noise ratio λ/σ are established in terms of m, n, km and kn. The first threshold, SNRc, corresponds to the computational boundary. We introduce a new linear time spectral algorithm that identifies the submatrix with high probability when the signal strength is above the threshold SNRc. Below this threshold, it is shown that no polynomial time algorithm can succeed in identifying the submatrix, under the hidden clique hypothesis. The second threshold, SNRs, captures the statistical boundary, below which no method can succeed in localization with probability going to one in the minimax sense. The exhaustive search method successfully finds the submatrix above this threshold. In marked contrast to submatrix detection and sparse PCA, the results show an interesting phenomenon that SNRc is always significantly larger than SNRs, which implies an essential gap between statistical optimality and computational efficiency for submatrix localization.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Statistical-Computational Tradeoffs in Planted Problems and Submatrix Localization with a Growing Number of Clusters and Submatrices

We consider two closely related problems: planted clustering and submatrix localization. In the planted clustering problem, a random graph is generated based on an underlying cluster structure of the nodes; the task is to recover these clusters given the graph. The submatrix localization problem concerns locating hidden submatrices with elevated means inside a large real-valued random matrix. O...

متن کامل

Submatrix localization via message passing

The principal submatrix localization problem deals with recovering a K ×K principal submatrix of elevated mean μ in a large n × n symmetric matrix subject to additive standard Gaussian noise. This problem serves as a prototypical example for community detection, in which the community corresponds to the support of the submatrix. The main result of this paper is that in the regime Ω( √ n) ≤ K ≤ ...

متن کامل

Computational aspect to the nearest southeast submatrix that makes multiple a prescribed eigenvalue

Given four complex matrices $A$‎, ‎$B$‎, ‎$C$ and $D$ where $Ainmathbb{C}^{ntimes n}$‎ ‎and $Dinmathbb{C}^{mtimes m}$ and let the matrix $left(begin{array}{cc}‎ A & B ‎ C & D‎ end{array} right)$ be a normal matrix and‎ assume that $lambda$ is a given complex number‎ ‎that is not eigenvalue of matrix $A$‎. ‎We present a method to calculate the distance norm (with respect to 2-norm) from $D$‎ to ...

متن کامل

A Simplified Curved Boundary Condition in Stationary/Moving Boundaries for the Lattice Boltzmann Method

Lattice Boltzmann method is one of computational fluid dynamic subdivisions. Despite complicated mathematics involved in its background, end simple relations dominate on it; so in comparison to the conventional computational fluid dynamic methods, simpler computer programs are needed. Due to its characteristics for parallel programming, this method is considered efficient for the simulation of ...

متن کامل

A crack localization method for beams via an efficient static data based indicator

In this paper, a crack localization method for Euler-Bernoulli beams via an efficient static data based indicator is proposed. The crack in beams is simulated here using a triangular variation in the stiffness. Static responses of a beam are obtained by the finite element modeling. In order to reduce the computational cost of damage detection method, the beam deflection is fitted through a poly...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016